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DETAILED ACTION 



Election/Restrictions 



Applicant's election with traverse of species 1 pertaining to claims 1-11, 19-29, 
37-47, and 55-65 in the reply filed on 4/29/2004 is acknowledged. The traversal is on 
the ground(s) that a search for the invention defined by the claims of Species 1 will 
require a search that encompasses the claims of Species 2 and, thus, the claims 
covering both species will be searched. This is not found persuasive because this 
argument only applies to restrictions. In order to traverse a species election, Applicant 
must submit evidence showing that the species are not patentably distinct. Should 
applicant traverse on the ground that the species are not patentably distinct, 
applicant should submit evidence or identify such evidence now of record 
showing the species to be obvious variants or clearly admit on the record that 
this is the case. In either instance, if the examiner finds one of the inventions 
unpatentable over the prior art, the evidence or admission may be used in a 
rejection under 35 U.S.C. 103(a) of the other invention. 



The requirement is still deemed proper and is therefore made FINAL. 
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Drawings 



Figures 1-10c should be designated by a legend such as -Prior Art- because 
only that which is old is illustrated. See MPEP § 608.02(g). Corrected drawing sheets 
are required in reply to the Office action to avoid abandonment of the application. The 
replacement sheet(s) should be labeled "Replacement Sheet" in the page header (as 
per 37 CFR 1 .84(c)) so as not to obstruct any portion of the drawing figures. If the 
changes are not accepted by the examiner, the applicant will be notified and informed of 
any required corrective action in the next Office action. The objection to the drawings 
will not be held in abeyance. 



The title of the invention is not descriptive. A new title is required that is clearly 
indicative of the invention to which the claims are directed. 



The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 



Specification 



Claim Rejections - 35 USC § 102 



A person shall be entitled to a patent unless - 
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Art Unit: 2612 



(e) the invention was described in (1) an application for patent, published under section 122(b), by 
another filed in the United States before the invention by the applicant for patent or (2) a patent 
granted on an application for patent by another filed in the United States before the invention by the 
applicant for patent, except that an international application filed under the treaty defined in section 
351(a) shall have the effects for purposes of this subsection of an application filed in the United States 
only if the international application designated the United States and was published under Article 21(2) 
of such treaty in the English language. 



Claims 1-2, 9-11, 19-20, 27-29, 37-38, 45-47, 55-56, 63-65, and 73 rejected 
under 35 U.S.C. 102(e) as being anticipated by Matsumoto et al. US 6,677,992. 

Re claim 1, Matsumoto discloses in figure 1 an imaging apparatus (1) including a 
CCD (2) capable of imaging an object at a shutter speed that is different from field to 
field (col. 8, lines 9-15). Therefore, an object is sensed under different exposure 
conditions in order to acquire a plurality of images. Based on a field judgement signal, a 
digital signal produced at a first shutter speed to render a field (A) is output from a first 
selector (22) and a digital signal produced at a second shutter speed to render a field 
(B) is output from a second selector (23) (col. 8, lines 63-67). A first multiplier (27) and 
a second multiplier (28) multiply the digital image signals of fields (A) and (B) according 
to functions stored in LUTS (25,26) (col. 9, line 1 - col. 10, line 30). Therefore, the 
levels of the images are compensated on the basis of the different exposure conditions 
of the images. The compensated images are then synthesized in order to produce a 
single synthetic image having a wide dynamic range (col. 10, lines 30-42). When the 
sum of coefficients (f,g) exceeds 1 a compression circuit is installed to produce a 
compressed image (col. 10, lines 33-42). Therefore, depending on the performance of 
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the output destination the synthetic image is compressed to produce a compressed 
image. 

Re claim 2, figure 3B disclosed by Matsumoto shows the curves of two different 
weight functions (f,g) that are output to a first and second multiplier (27,28). The first 
multiplier (27) multiplies a pixel of field (A) by a cosine squared function and the second 
multiplier (28) multiplies a pixel of field (B) by a sine squared function (col. 9, lines 32- 
39). Each of these functions includes a correction coefficient (p) that serves to vary the 
weight functions (f,g) according to the brightness level of the different digital signals 
according to fields (A.B) (col. 7, lines 58-64). Also, the correction coefficient (p) ensures 
that the sum of the weight functions (f.g) will never exceed 1 . According to figure 5, 
when a brightness level is higher than 0 and lower than ys1 , the weight (f) for field (A) is 
larger and the weight (g) for field (B) is smaller (col. 1 0, lines 4-1 1 ). Similarly, when a 
brightness level is higher than ys1 the weight (f) for field (A) is lower and the weight (g) 
for field (B) is higher (col. 10, lines 12-16). The output (Ma) is produced by weighting 
the image signals x1a and x2a with weight coefficients (f,g) and adding them up (col. 
10, lines 43-46; fig. 5) It can be seen that when the weight functions (f,g) are applied to 
the digital signals (x1 ,x2) they will serve to decrease the pixel level as long as either (f) 
or (g) is not 1 (figure 5). Therefore, a positive value is subtracted from the pixel level of 
each of the plurality of images to produce a compensated image (x1 * cos 2 (px) for field 
(A); x2 * sin 2 (px) for field (B)). 



Application/Control Number: 09/468,053 Page 6 

Art Unit: 2612 

Re claim 9, each of the images disclosed by Matsumoto includes brightness 
signals (y.ysl ,etc.) and color signals (R,G,B) (col. 8, lines 44 - col. 9, line 27; co. 1 1 , 
lines 55-65). The brightness signals and color signals are separated and the brightness 
and color signals are compensated according to claims 1 and 2 above (col. 1 1 , lines 55- 
65). The steps according to claims 1 and 2 are performed for the red, blue, and green 
dynamic range expanding circuits (15R, 15B, 15G) (col. 9, lines 52-55). Therefore, the 
compensated brightness and color signals are synthesized and compressed according 
to the same procedures as described in claims 1 and 2 above. 

Re claim 10, figure 3B disclosed by Matsumoto shows the curves of two different 
weight functions that are output to a first and second multiplier (27,28). The first 
multiplier (27) multiplies a pixel of field (A) by a cosine squared function and the second 
multiplier (28) multiplies a pixel of field (B) by a sine squared function (col. 9, lines 32- 
39). Each of these functions includes a correction coefficient (p) that serves to vary the 
weight functions (f,g) according to the brightness level of the different digital signals 
according to fields (A,B) (col. 7, lines 58-64). Also, the correction coefficient (p) ensures 
that the sum of the weight functions (f,g) will never exceed 1 . According to figure 5, 
when a brightness level is higher than 0 and lower than ys1 , the weight (f) for field (A) is 
larger and the weight (g) for field (B) is smaller (col. 10, lines 4-1 1 ). Similarly, when a 
brightness level is higher than ys1 the weight (f) for field (A) is lower and the weight (g) 
for field (B) is higher (col. 10, lines 12-16). The output (Ma) is produced by weighting 
the image signals x1a and x2a with weight coefficients (f,g) and adding them up (col. 
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10, lines 43-46; fig. 5) It can be seen that when the weight functions (f,g) are applied to 
the digital signals (x1 ,x2) they will serve to decrease the pixel level as long as either (f) 
or (g) is not 1 (figure 5). Therefore, a compensation amount (f,g) is calculated based on 
a brightness signal and the compensation amount (f,g) is used to produce a 
compensated brightness signal (x1 * cos 2 (px) for field (A); x2 * sin 2 (px) for field (B)). 
Finally, a compensated color signal (Ma) is produced based on the compensated 
brightness signal (col. 10, lines 43-46; fig. 5). 

Re claim 11, a synthetic picture signal including both brightness and color signals 
using the techniques disclosed in claims 1 and 2 (col. 10, lines 23-32). If the level of the 
synthetic picture signal exceeds the saturation value, a compression circuit is installed 
(col. 10, lines 33-42). Therefore, the synthetic picture signal is a mixed signal including 
compressed brightness and color signals. 

Re claims 19, 37, and 55, see claim 1. 

Re claims 20, 38, and 56, see claim 2. 

Re claims 27, 45, and 63, see claim 9. 



Re claims 28, 46, and 64, see claim 10. 



Application/Control Number: 09/468,053 Page 8 

Art Unit: 2612 

Re claims 29, 47, and 65, see claim 1 1 . 



Re claim 73, Matsumoto discloses in figure 1 an imaging apparatus (1) including 
a CCD (2) capable of imaging an object at a shutter speed that is different from field to 
field (col. 8, lines 9-15). Therefore, an object is sensed under different exposure 
conditions in order to acquire a plurality of images. Plural images are synthesized in 
order to produce a single synthetic image having a wide dynamic range (col. 10, lines 
30-42). When the sum of coefficients (f,g) exceeds 1 a compression circuit is installed 
to produce a compressed image (col. 10, lines 33-42). Therefore, depending on the 
performance of the output destination the synthetic image is compressed to produce a 
compressed image. Based on a field judgement signal, a digital signal produced at a 
first shutter speed to render a field (A) is output from a first selector (22) and a digital 
signal produced at a second shutter speed to render a field (B) is output from a second 
selector (23) (col. 8, lines 63-67). A first multiplier (27) and a second multiplier (28) 
multiply the digital image signals of fields (A) and (B) according to functions stored in 
LUTS (25,26) (col. 9, line 1 - col. 10, line 30). Therefore, the levels of the images 
acquired by the CCD (2) are compensated on the basis of the different exposure 
conditions of the images and the synthesizing means is supplied with the compensated 
images (col. 10, lines 30-42). 
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Claim Rejections - 35 USC § 103 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 3-5, 21-23, 39-41, and 57-59 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Matsumoto in view of Fukuda et al. US 6,278,490. 

Re claim 3, Matsumoto discloses all of the limitations of claim 2 above. In 
addition, Matsumoto states that image signals (x1a,x2a) corresponding to fields A and 
B respectively are multiplied by weight functions (f=cos 2 (px) for field (A); g=sin 2 (px) for 
field (B)) (col. 9, lines 24-50). A signal (x) of the weight functions (f,g) is multiplied by a 
correction coefficient (p) according to the brightness level and exposure time of an 
image signal (col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a 
factor (f,g) that is set based on the exposure condition of an image signal in order to 
calculate a positive value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As 
shown in figure 5, image signals (x1a) and (x2a) always have a positive value and the 
sum of weight functions (f,g) must always be 1 (col. 10, lines 33-34). Thus, (x1a * 
cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are always positive values that are less 
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than the original image signals (x1a and x2a). Although Matsumoto discloses all of the 
limitations above, he fails to distinctly state that a mean pixel value of each of the 
images is calculated. 

Fukuda discloses in figure 8 an image pickup apparatus that includes a detection 
circuit (23) that detects variations in light emission amount from image data of two 
frames with different exposure amounts and a correction circuit (24) that corrects image 
data on the basis of a signal obtained by the detection circuit (23) (col. 12, lines 26-35). 
The detection circuit (23) calculates the average values of image data of signals having 
different exposure times (col. 12, lines 36-48). Therefore, it would have been obvious 
for one skilled in the art to have been motivated to include the detection circuit (23) 
capable of calculating the average values of image data of signals having different 
exposure times as disclosed by Fukuda in the imaging apparatus capable of multiplying 
image signals by weight functions (f,g) as disclosed by Matsumoto. Doing so would 
provide a means for calculating average values of image data for short and long 
exposure periods and using the calculated average values to manipulate the image data 
(Fukuda: col. 12, lines 36-48). 

Re claim 4, the positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field 
(B)) disclosed by Matsumoto are time-smoothed because they include cosine and sine 
functions (see figures 3B and 5). As shown in figure 5, image signals (x1a) and (x2a) 
always have a positive value and the sum of weight functions (f,g) must always be 1 
(col. 10, lines 33-34). Therefore, when the weight functions (f,g) are each equal to (0.5), 



Application/Control Number: 09/468,053 Page 1 1 

Art Unit: 2612 

the positive values (x1 a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are each 
equal to one-half of the original image signals (x1a, x2a). Thus, it can be seen that 
when the weight functions (f,g) are each equal to (0.5), subracting the time smoothed 
positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) from the original 
image signals (x1a, x2a) yields the same result as multiplying the original image signals 
(x1a, x2a) by weight functions (f,g). 

Re claim 5, A signal (x) of the weight functions (f.g) is multiplied by a correction 
coefficient (p) according to the brightness level and exposure time of an image signal 
(col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a factor (f,g) that 
is set based on the exposure condition of an image signal in order to calculate a positive 
value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As shown in figure 5, 
image signals (x1a) and (x2a) always have a positive value and the sum of weight 
functions (f,g) must always be 1 (col. 10, lines 33-34). Fields (A) and (B) represent 
images with different exposure times (col. 8, lines 63-67). As shown in figure 5, 
depending on the brightness level the weight functions or factors (f,g) are varied. When 
a brightness level is higher than 0 and lower than ys1 , the weigt (f) for field (A) is larger 
and the weight (g) for field (B) is smaller (col. 10, lines 1-11). Similarly, when a 
brightness level is higher than ys1 , the weight (f) for field (A) is smaller and the weight 
(g) for field (B) is larger (col. 10, lines 12-22). Therefore, it can be seen that depending 
on the brightness level the factor (f or g) is set larger for the image (A or B) having been 
sensed with a larger exposure. 
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Re claims 21 , 39, and 57, see claim 3. 
Re claims 22, 40, and 58, see claim 4. 
Re claims 23, 41 , and 59, see claim 5. 

Claims 6-8, 24-26, 42-44, and 60-62 rejected under 35 U.S.C. 103(a) as being 
unpatentable over Matsumoto in view of Sanner US 4,757,386. 

Re claim 6, Matsumoto discloses all of the limitations of claim 2 above. In 
addition, Matsumoto states that image signals (x1a,x2a) corresponding to fields A and 
B respectively are multiplied by weight functions (f=cos 2 (px) for field (A); g=sin 2 (px) for 
field (B)) (col. 9, lines 24-50). A signal (x) of the weight functions (f,g) is multiplied by a 
correction coefficient (p) according to the brightness level and exposure time of an 
image signal (col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a 
factor (f,g) that is set based on the exposure condition of an image signal in order to 
calculate a positive value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As 
shown in figure 5, image signals (x1a) and (x2a) always have a positive value and the 
sum of weight functions (f,g) must always be 1 (col. 10, lines 33-34). Thus, (x1a * 
cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are always positive values that are less 
than the original image signals (x1a and x2a). Although Matsumoto discloses all of the 
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limitations above, he fails to distinctly state that the signal each of the images is filtered 
by a low-pass filter. 

Sanner discloses in figure 1 video processor including an image sensor (12) with 
two output channels (14,16). Low-pass filters (22,26) are included in order to contain 
the modulation frequencies of the two channels (14,16) (col. 2, line 65 - col. 3, line 9). 
The pixels from each of the output channels (14,16) that are filtered by the low-pass 
filters (22,26) are finally combined by a multiplexer (40) to combine the pixels from each 
of the channels (14,16) into a single output (col. 3, line 63 - col. 4, line 4). Therefore, it 
would have been obvious for one skilled in the art to have been motivated to include the 
low-pass filters (22,26) capable of containing the modulation frequencies of the two 
channels (14,16) as disclosed by Sanner in the imaging apparatus capable of 
multiplying image signals by weight functions (f,g) as disclosed by Matsumoto. Doing 
so would provide a means for filtering image signals of different channels in order to 
contain the modulation frequencies of the two channels (col. 2, line 65 - col. 3, line 9). 

Re claim 7, the positive values (x1 a * cos 2 (px) for field (A); x2a * sin 2 (px) for field 
(B)) disclosed by Matsumoto are time-smoothed because they include cosine and sine 
functions (see figures 3B and 5). As shown in figure 5, image signals (x1a) and (x2a) 
always have a positive value and the sum of weight functions (f,g) must always be 1 
(col. 10, lines 33-34). Therefore, when the weight functions (f.g) are each equal to (0.5), 
the positive values (x1 a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) are each 
equal to one-half of the original image signals (x1a, x2a). Thus, it can be seen that 
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when the weight functions (f,g) are each equal to (0.5), subracting the time smoothed 
positive values (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B)) from the original 
image signals (x1a, x2a) yields the same result as multiplying the original image signals 
(x1 a, x2a) by weight functions (f,g). 

Re claim 8, A signal (x) of the weight functions (f,g) is multiplied by a correction 
coefficient (p) according to the brightness level and exposure time of an image signal 
(col. 7, lines 49-64). Therefore, a pixel value (x1a,x2a) is multiplied by a factor (f,g) that 
is set based on the exposure condition of an image signal in order to calculate a positive 
value (x1a * cos 2 (px) for field (A); x2a * sin 2 (px) for field (B). As shown in figure 5, 
image signals (x1a) and (x2a) always have a positive value and the sum of weight 
functions (f.g) must always be 1 (col. 10, lines 33-34). Fields (A) and (B) represent 
images with different exposure times (col. 8, lines 63-67). As shown in figure 5, 
depending on the brightness level the weight functions or factors (f,g) are varied. When 
a brightness level is higher than 0 and lower than ys1 , the weigt (f) for field (A) is larger 
and the weight (g) for field (B) is smaller (col. 10, lines 1-11). Similarly, when a 
brightness level is higher than ys1 , the weight (f) for field (A) is smaller and the weight 
(g) for field (B) is larger (col. 10, lines 12-22). Therefore, it can be seen that depending 
on the brightness level the factor (f or g) is set larger for the image (A or B) having been 
sensed with a larger exposure. 



Re claims 24, 42, and 60, see claim 6. 





Application/Control Number: 09/468,053 
Art Unit: 2612 



Page 15 



Re claims 25, 43, and 61 , see claim 7. 



Re claims 26, 44, and 62, see claim 8. 



Conclusion 



The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Kamishima et al.US 6,078,359 discloses image pickup with expanded dynamic 
range where the first exposure is adjustable and second exposure is predetermined. 

Wada JP 05-167889 discloses an image processing circuit by which uneven 
illumination can be eliminated. 

Wada JP 06-319149 discloses a picture processing unit to attain excellent color 
picture display by setting a coefficient for saturation correction. 
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